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ABSTRACT 

This thesis reviews four of the existing matrix methods for finding 
the shortest path in a network, including the little known matrix method 
by Floyd. Floyd's method is then extended to determine all best paths. 
After a brief review of the nth best path problem, Floyd's method is 
again extended to determine the nth best path. Finally, the nth best 
path problem is investigated to determine its applicability to the travel- 
ing salesman problem. 
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1. Introduction 



Four matrix methods to determine the shortest path in a network 
will be presented. After an explanation of each method there will follow 
a simple example to illustrate the procedure. 

First, the method of matrix manipulation [3] will be set forth. 

Next, an improvement on this, the Cascade algorithm [7], will be pre- 
sented. The two algorithms that appear to be the most efficient are 
next. Algorithm 97 was published by Floyd [8] in 1962 and went unnoticed 
for some time. In 1965 Murchland [15] published what he called "a new 
method," but which in reality was the same as Floyd's. A different 
approach but equally as efficient as Floyd's was put forth in 1966 by 
Dantzig [6] and is an inductive procedure. 

In many practical problems a shortest route is not sufficient. All 
alternate shortest routes or the n best routes are needed. Thus a 
simple extension to Floyd's algorithm to determine all alternate routes 
will be presented. Following this will be a brief review of the nth best 
path problem and a second extension to Algorithm 97. This extension will 
determine the n best paths from all nodes i to all nodes j. 

A logical extension of this method of determining all n best paths 
is to the traveling salesman problem. Although this problem is not solved 
here, a possible approach is set forth. 

2. Notation 

A graph or network, denoted 6 = (X,U), is composed of two sets X 

and U, 

X = [i ; i=l , ••• , n] 

U = [(i ,j ) ; i t X and j e X] . 
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X is the set of nodes or vertices and the pair (i,j) e U is called an 
arc, where i is the initial node and j is the terminal node. Two nodes 
i and j are adjacent if they are distinct and there exists an arc u=(i,j) 
or v=(j,i). A path is a sequence (u-|,U 2 , •••) of arcs of a network (X,U) 
such that the terminal node of each arc coincides with the initial node 
of the succeeding arc. A finite path in which the initial node coincides 
with the terminal node is called a circuit. The length of a path is the 
sum of the lengths of the arcs forming the path. 

The matrix M associated with the network is a vertex-vertex matrix. 

M = [m^-j] , 

where the element m-jj is the length of the arc from node i to adjacent 
node j, if no such arc exists then m^j is equal to infinity. The dis- 
tance m.jj can be less than, equal to, or greater than zero, but the 
length of any circuit must be non-negative. In general, m^j does not 
necessarily equal mj.,- and m.jj does not have to satisfy the triangular 
inequality 

’’’i j - ^i k '^kj • 

The shortest distance matrix M* has elements m*j equal to the 
distance of the shortest path from i to j. Thus m*j is the distance 
of the path from i to j, whose sum of arcs is at a minimum. 

Following Murchland [15], the symbol shall denote "is 
replaced by." 

Following Bellman and Kalaba [1], 

min^ (x-|,X 2 , •••, Xp) = the nth smallest value of 

the quantities x^* . 

Symbols frequently used are defined below. 

ND = the number of nodes in the network. 

INF = infinity, and is taken to be greater than the maximum 
distance of any possible path. 
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All matrices in the sequel represent vertex-vertex distance 
matrices. 

3. The Shortest Path by Matrix Manipulation 

The first method of determining the shortest path in a network, 
that of matrix manipulation [3], involves two operations. These opera- 
tions play the roles of elementary addition and multiplication 
respecti vely. 

Define the sum of two matrices 
C = A + B 
as 

c^-j = min(a.jj ,b^.j) . (1) 

where a^j and b.jj are corresponding elements. 

Furthermore, define the product of two matrices 
C = AB 
as 

Cij = min(a^-|^ + b|^j). (2) 

k 

M contains elements that are the arc distances between adjacent 
nodes. Following equation (2), M^ contains elements that are equal to 
the shortest distance, from i to j , in a path containing exactly two 
arcs. In general M*^ contains elements equal to the shortest distance, 
from i to j, in a path containing exactly k arcs. 

Thus, the shortest distance matrix, 

M* = M + M^ + • • • + M'^-’’ , (3) 

contains elements equal to the minimum distance, from i to j , for all 
paths containing from one to n-1 arcs. 

As an example, consider the network in figure 1 and its associated 
initial distance matrix M, given below. 
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7 


5 


3 


M = 


1 


INF 


4 




INF 


1 


INF 



Using equation (2) we obtain for elements m^(l,l) and m2(l,2), 
m2(l ,1) = min(7 + 7,5 + 1 ,3 + INF) = 6 
m2(l,2) = min(7 + 5,5 + INF, 3 + 1) = 4. 

After computing the rest of the elements in similar fashion, we obtain 
the following matrix. 

From equation (3) and using addition as defined in equation (1), we 
obtain the following shortest distance matrix. 





6 


4 


9 


= 


8 


5 


4 




2 


INF 


5 



M* = 


6 


4 


3 




1 


5 


4 




2 


1 


5 



In general is a matrix using exactly n-1 arcs and visiting 

all n nodes, would be needed if a shortest circuit from a node back 
to itself was desired. In general 

MO = M* + M" 

where M° shows the length of the shortest circuit from a node back to 
itself. For the above example 



i3 . 



and 



/.O ^ 



5 


i 10 ; 


6 


I 5 i 


9 


i 6 


5 


4 


1 


5 


2 


1 



is the shortest circuit matrix. 
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Nptwork for Matrix Manipulation Example 




Netv/ork for Cascade Algorithm Example 
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4. The Cascade Algorithm 

Whereas the previous method needed n-1 matrix operations, i.e. 
for j = 2, • • • , n-1 and one summation, the Cascade algorithm [7] needs 
only two matrix squarings. (This method is called the Cascade Algorithm 
by [7] and the Revised Matrix Algorithm by [12].) 

In this method newly calculated elements immediately replace 
existing elements. Also, now the order of calculation becomes important. 
In the first squaring, the so-called forward Cascade process, the elements 
are calculated in the order m]], m-|2» • * •> niin; m2i, • • • m2nJ • • •; 
mnl . ' ' ' Unn* Then in the second squaring, the so-called backward 
Cascade process, the elements are calculated in the order mpn, mn^n-], 

• • - mm; ‘ ^In. • * • mn . 

Let MP = [m*? .] , where 
1 j 



P = 



initi al ly 

at the end of the forward process 
at the end of the backward process 



Thus = M, which is the initial arc matrix previously defined 
and M is still the shortest distance matrix. 

is obtained from M^ by the following forward process. 



F c| r 

m. . :=min (m. , + m, . ) 
ij k Ik kj 



(4) 



where 



and 



r = 



[l 



k i j 
k < j 



k ^ i 
k < i . 



(5) 



r ■ 

M is then obtained from by the followina backward process. 



ri. .:~min (m' + m, .) 

I. ik kj' 



( 6 ) 
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where 

and 



q = 



k 1 j 
k > j 



k > i 



( 7 ) 



To illustrate the above procedure, consider the network in figure 2 
and its associated initial distance matrix given below. 



M = 



0 


4 


1 


INF 


INF 


0 


1 


1 


INF 


1 


0 


4 


INF 


INF 


INF 


0 



Beginning the forward process using equations (4) and (5), 

4 



mi2:=min 



m^l + m|2 = 0 + 4 



m|2 1^22 = 4 + 0 = 4 

’’^13 '’’L ^ ^ ^ ^ ^ 

m]4 + m42 = INF + INF = INF 



2 < m 



1 

12 ' 



Since 2 is less than m |25 replacement would take place. 

m^3:=min (0 + 1 ,2 + 1 ,1 + 0,IMF + INF) = 1 
Since mj^ = m^^ no replacement need be done, although when using the 



computer, replacement would automatically take place. 

F 



m 



14 



;=min (0 + IMF, 2 + 1,1 + 4, INF + 0) = 3 < m 



1 

14 



1 



Therefore mi 4 :=mi 4 would in fact take place. After computing the remain- 
ing elements and replacing when necessary, we obtain the following matrix. 



0 


2 


1 


3 


IMF 


0 


1 


1 


INF 


1 


0 


2 


INF 


IMF 


INF 


0 



= 



After performing the backward process using equations (6) and (7), we 
obtain the shortest distance matrix M* as shown. 



M* = 



0 


2 


1 


3 


INF 


0 


1 


1 


IMF 


1 


0 


2 


INF 


IMF 


IMF 


0 
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Thus we see that this is exactly the same as matrix squaring with 
the exception of replacing the elements once shorter paths are found. 

This replacing cuts down the number of operations performed tremendously, 
relative to the matrix manipulation method. 

Narahari Pandit [16] first claimed that two forward processes were 
enough. However, [7] displayed a counterexample and proved one forward 
and one backward process was sufficient. Hu [12] later proved that three 
forward processes are sufficient. 



5. An Inductive Approach 

Dantzig [6] takes somewhat of a different approach to solve the 

shortest path problem. His inductive approach is described below. 

0 

Assume for nodes 1,2,- • • , k-1 that optimal distances m^j are 

* 

given. Optimal distances m^j are desired for nodes 1,2, • • 



k. 



For h = 1 , 



, k - 1 and j = 1 , 



k - 1 



kh ■= "ij" ('"kj + "’jh) 


(8) 


hk = ("’jk + "ihj) 


(9) 


'kk = % + "’jk) 

J 


(10) 


1 and j = 1 , • • • , k - 1 




1 ^ j : =mrn | ( m^- j ,nrj |<. + mr|^ j ) 


(n) 



For i = 1 



Consider the network in figure 3 and its associated initial distance 
matrix given below. 

M 

Assume we have found optimal distances m?. for nodes 1, 2, 3 thus 

* vJ 



0 


1 


5 


INF 


INF 


0 


3 


1 


INF 


5 


0 


INF 


INF 


INF 


1 


0 



giving Ir. 



M'- 



0 


1 


4 


INF 


0 


3 


INF 


5 


0 
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Figure 3 

Network for Inductive Example 




Figure 4 

Network for Algorithm 97 Example 
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★ 

To obtain m^j for nodes 1,2, • • *, k, we begin by using 



equation (8). 



* 



'"4h 



For h = 1,2,3 
* 

m4i 



min 



0141 

ni42 + ni2h 

ni43 + 



min (INF + 0,INF + INF,1 + INF) = INF 



m^2 = min (INF + 1,INF + 0,1 + 5) = 6 
m *3 = min (INF + 4), INF + 3,1 + 0) = 1 
Concluding the calculations and replacements using equations (9), (10) 

ic 

and (11) we obtain M . 



0 


1 


3 


2 


INF 


0 


2 


1 


INF 


5 


0 


6 


INF 


6 


1 


0 



6. Algorithm 97 

Unnoticed for some time was the following algorithm by Floyd [8]. 

The two *'d statements were not in the original program but have been 

added to reduce operations. The program is written in FORTRAN IV. 

DO 1 I = 1, ND 

DO 1 J = 1 , ND 

IF(M(J,I).EO.INF) GO TO 1 
*IF(I.EQ.J) GO TO 1 
DO 1 K = 1 , ND 
IF(M(I,K).EQ.INF) GO TO 1 
*IF(I.EQ.K) GO TO 1 
MS = M(J,I) + M(I,K) 

IF(MS.GE.M(J,K)) GO TO 1 
M(J,K) = MS 
1 CONTINUE 

Flow diagram for the above program is contained in appendix I. 

This is similar to the previous matrix squaring methods. It is not 
actually a matrix squaring but resembles it. It performs the same opera- 
tion as the Cascade algorithm, 

mjk:=min(mj|^,mj.j + m^-|^) 
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but calculates nij|^ in a different order. Thus, by this order needs only 

ic 

a single "squaring." Upon "squaring" nij|^ is now mj|^. 

After a brief informal discussion of the algorithm an example will 
be worked to illustrate the procedure. 

The matrix M is searched, in an order to be described shortly, for 
non-infinity, non-main-diagonal elements. Two of these elements are 
added and compared with a third element. Replacement is then made if the 
sum is less than the third element. 

The search is as follows. The columns of M are searched in order, 
i = 1 , • • • , ND. Each column i is searched in order, j = 1, • • • , ND. 
When a non-infinity element ( j , i) is encountered in column i, row i is 
searched in order, k = 1, • • *, ND. For all non-infinity elements in 
row i , set 



ms = mj.j + m.j|^. 

If ms < mji^, then mj|^:=ms. Thus we have formed a shorter path from j to 
k by combining two paths j to i and i to k. 

As an example consider figure 4 and the following associated initial 
distance matrix. 
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1 


2 


3 


INF 


INF 


INF 


INF 


INF 


0 


1 


2 


1 


INF 


INF 


INF 


INF 


INF 


0 


1 


INF 


2 


INF 


INF 


INF 


INF 


INF 


0 


INF 


1 


3 


4 


INF 


INF 


INF 


1 


0 


INF 


4 


INF 


INF 


INF 


INF 


INF 


INF 


0 


2 


3 


INF 


INF 


INF 


INF 


2 


INF 


0 


1 


infI 


INF 


INF 


INF 


INF 


INF 


INF 


0 



Applying the algorithm to M we see that except for i =1 = j, 
column 1 has no non-infinity elements. Incrementing i to 2, the first 
non-infinity column element encountered is mj.j = mi2- Now row 2 is 
searched and the first non-infinity element is m^i^ = m 23 . Thus for the 



first comparison, , „ 

I . ms = m.| 2 + ^22 

= 1 + 1=2 

Since 2 = ms = m .|2 = 2, 
17 



no replacement is needed. The two remaininq non-infinity elements in 
row 2 are the next elements utilized. 

2 . ms — m^ 2 ^^4 

= 1+2 = 3 
3 = ms = m-|^ = 3 
ms 

3. ms = m-|2 + m2g 

= 1 + 1=2 
2 = ms < ^15 = INF 

mi 5: =2 

For i = 3 the followinq two renlacements would take place in order 

Given. 



4. 


II 


5. 





After the remainino columns, i =4, * * *, 8, have been searched 
and required replacements made, the shortest distance matrix is obtained 
and is aiven below. 



0 


1 


2 


3 


2 


4 


6 


7 


INF 


0 


1 


2 


1 


3 


5 


6 


INF 


INF 


0 


1 


6 


2 


4 


5 


INF 


INF 


INF 


0 


5 


1 


3 


4 


INF 


INF 


INF 


1 


0 


2 


4 


5 


INF 


INF 


INF 


5 


4 


0 


2 


3 


INF 


INFilNF 


3 


2 


4 


0 


1 


INF 


INFl 


INFl 


INF 


INF 


INF 


INF 


0 



Floyd [8] gave no proof of his algorithm but relied for proof on a 
theorem on boolean matrices by Warshall [19]. Hu [11] gives a somewhat 
simpler proof of Floyd's algorithm. Murchland [15] developed a similar 
algorithm, unaware of Floyd's accomplishment, and presents a somewhat 
lenqthly proof in his paper. 
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If we are interested in not only the distance of the shortest path 
but the route as well, somethina more than just M* is needed. One way 
to obtain the path is to define a new matrix, called the routing matrix. 



MR =[mrj|^] , 

where mr^j^ contains the number of the first node, after j, on the path 
from j to k. Initially, 

mr^i^ = k, for j, k = 1 , • • ' , n. 

During the calculation, whenever 

mjk-niji + m.|^ , 

the following replacement is also made. 



In the previous example the first replacement is done in comparisons. 



Thus 

m , 5:=2 , 

would be followed by 

mr-|g:=mri2 = 2 . 

At the conclusion of the above example the routing matrix would be 
as shown as follows. 



1 


2 


3 


4 


2 


3 


4 


4 


1 * 


2 


3 


4 


5 


3 


4 


4 


1 * 


2 * 


3 


4 


4 


6 


4 


4 


1 * 


2 * 


3 * 


4 


7 


6 


7 


8 


1 * 


2 * 


3 * 


4 


5 


4 


7 


4 


1 * 


2 * 


3 * 


7 


7 


6 


7 


8 


1 1 * 


2 * 


3 * 


5 


5 


5 


7 


8 


1 * 


2 * 


3 * 


4 * 


5 * 


6 * 


7 * 


8 



The elements with the stars are elements as they were initialized. 
No replacement took place since no finite path exists, as can be seen 
in M*. In the computer program these starred elements would be set to 
infinity to facilitate reading MR. 
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To illustrate the procedure of extracting a path from MR, the path 
from node 1 to node 8 would be 
mr,8 = 4 

mr4g = 8 

or 

1 to 4 to 8. 

It may be observed from the example that more than one shortest 
path exists from 1 to 8. Algorithm 97 will only give the first best path. 
The modification required to extract all alternate paths shall be treated 
in the following section. 

The above procedure of using the routing matrix to determine the 
paths is applicable, not only to Algorithm 97 but to all four matrix 
methods. 

7. Comparison of Methods 

Already some idea exists of the relative efficiency of the four 
methods discussed. Simply in terms of number of matrix squarings, the 
matrix manipulation method requires n-1, the Cascade algorithm two, and 
Algorithm 97 one. To more critically compare all four methods let's con- 
sider the basic operations involved. A matrix multiplication between two 
matrices of order n requires three basic operations. These operations 
are indexing, addition, and comparison. Below is a listing of the four 
methods and next to each, the number of each of the basic operations 
required. 

Matrix Manipulation - n log (n-1) 

3 

Cascade Algorithm - 2n 

Induction Method - n(n-l) (n-2) 

Algorithm 97 - n(n-l) (n-2) 
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8. All Alternate Best Paths 

In practical problems it may arise that all alternate best paths are 
wanted. A decision maker may want to evaluate all best paths and select 
from them by means of some other criterion. To extract all best paths 
Algorithm 97 must be modified sliqhtly. 

For the shortest path problem we needed two ND x MD matrices, M and 
MR. For this problem M will remain the same. Recall that mr^j^ contains 

the number of the first node, after j, on the path from j to k. Mow 

since we want to keep all best paths we must go to a three-dimensional 
matrix. The third dimension on MR is not governed by the number of best 
paths from j to k but by the number of first nodes on the path from j to 
k. A number of paths may share the same first node and later branch off. 
Consider the paths u = (1-2-4-7-8) and v = (1-2-4-6-8). Mode 2 need only 
be stored once, since paths u and v coincide from node 1 to node 4. Indi- 
cation of a branch would occur at node 4. Here two first nodes would 
appear, node 6 and node 7. 

A priori it is not known how many best paths there may be from j to 

k. Thus it also is not known how many first nodes are needed. This is 

of no real concern if calculations are going to be done with pencil and 
paper. For the computer, however, a specific number is needed. Inspec- 
tion of the given network can aive an indication of the maximum number of 
first nodes expected. Let MA denote this maximum number. Surely 

NA £ MD. 

Thus MR would be dimensioned MD x MD x MA and nirj|^. would contain the 
number of the ith first node, after j , on a best path from j to k. In 
the computer program, to facilitate printing out the paths and readino 
the matrices, infinity for h = 2, * * *, MA. Also, upon 

completion of the algorithm, for all elements m^j^ equal to infinity, the 
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corresponding elements are set to infinity. Thus the routino matrix 

will also indicate all non-existing paths. 

For the computer program in appendix III, a value was read in for NA. 
If during execution of the program the number of first nodes becomes 
equal to NA, an error message will be printed and execution will cease. 
This will prevent the computer from attempting to address either outside 
the matrix or wrong elements in the matrix. Since computer time may be 
costly the program could be altered so as to ignore all additional first 
nodes once the total number exceeded NA. An error message would still be 
desired to indicate that alternate paths may have been thrown away. 

Now the modification of Alaorithm 97 will be explained to enable us 
to extract all best paths. Departure from the main algorithm occurs at 
the point where path (j,k) is compared with the sum of the two paths 
(j,i) and (i,k). If the sum is greater, that path, as before, is ignored. 
Now let us consider separately the cases where the sum is less than and 
where it is equal to m^j^. 

For the case "less than," a path has been found that is shorter than 
the existing path. This is the same as for the shortest path. Now, 
however, 

"j-kp-' ""'.Up p “ 



In the previous section for the shortest path, p was equal to one. Now 
there may already exist more than one first node at Therefore they 

all must be transferred to (It is true that there may not be NA 

first nodes at ^I'^j-jp* Th® transfer could be handled a number of ways on 
the computer. One way would be to determine which of the NA elements are 
first nodes and transfer only them. The other way is as above, transfer 
all NA elements. Whichever is more efficient would depend on the par- 
ticular matrix. ) 
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For the case "equal to," a path has been found that is the same 
distance as the existing path. This we want to keep. Now a comparison 
must be made between the first nodes of and Only first 

nodes of mr.,. that are distinct from the first nodes of mr.. will be 

Jiq Jkp 

transferred to Redundancy of first nodes would only take up 

storage space and no paths will be thrown away by the discarding. 

As an example consider the network in figure 4. M and M* remain 
unchanged. The routing matrix would now be as given below. 
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2 
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2 
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4 
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3 


INF 






2 
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4 


3 


5 


5 
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4 
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4 


3 


5 


4 
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INF 






INF 






3 






4 






4 


6 




6 


4 




4 


6 




4 


6 




INF 






INF 






INF 






4 






7 


6 




6 






7 


6 




8 


6 


7 


INF 






INF 






INF 






4 






5 






4 






7 


4 




4 


7 




INF 






INF 






INF 






7 






7 






6 






7 






8 


7 




INF 






II NF 






INF 






5 






5 




5 






7 




1 

1 


8 






INF 






■INF 






INF 






'INF. 






INF' 1 1 


liNFi 




1 


INF 




1 


8 







The columns of MR are divided by double lines. Between the double 
lines are the elements of the third dimension, the first, second and third 
first nodes of the alternate paths from j to k. It can be shown that 
there are 25 alternate paths from node 1 to node 8. 

Appendix II shows the flow diagram, for the algorithm. The full 
computer program is shown in appendix III. 

9. Nth Best Path 

A generalization of the shortest path problem is the nth best path 
problem. It may arise that the shortest path(s) may not be the "best" 
path when evaluated by some other criterion. A decision maker may be 
willing to deviate from the shortest path(s) by a certain amount to avoid 
undesirable aspects of the shortest path(s). Thus the nth best path 
becomes important. 

First a brief review of the known methods is in order. The simplest 
method is given by Pollack [17]. The network must first be solved for 
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the shortest path, say u. Actually all shortest paths, Up, must be 
found. Once given Up, from a given node j to a given node k, composed 
of rp arcs, the length of each arc in Up is set, in turn, to infinity. 

The shortest path problem is solved (at most) rp times for each Up, once 
for each arc set to infinity. (An arc appearing in more than one Up 
need be set to infinity only once.) Thus the maximum number of shortest 
path problems to be solved is equal to the sum of the The short- 

est of these new best paths is the second best path, say v. There may 
be more than one second best path. Thus v^ will denote the qth second 

best path and will have s arcs. 

q 

For the third best path, the length of each arc of u and v is set, 

P P 

in turn, to infinity. Extending this to the nth best path, the length 
of each arc of all first best, second best, * * *, n-1 best paths must 
in turn be set to infinity. As before, for each arc set to infinity a 
shortest path problem must be solved. By now it must be apparent that 
the number of shortest path problems to be solved may quickly become 
astronomically large. Thus this method appears to be good only when r 
and s are small and when p and q are very small, hopefully one. 

The method of Bock, Kanter, and Haynes [5] differs from Pollack's 
in that the shortest path need not be known a priori. Using stems and 
trees, this method simply is a systematic listing of all paths from a 
given j to a given k. Again, however, this method is limited to small 
networks. 

As in the two previous, the method of Hoffman and Pavley [10] 
determines the nth best path from a given j to a given k. However, now 
not only the knowledge of the shortest path from j to k is required, but 
the knowledge of all shortest paths from j to all other nodes in the 
network. Then by deviations from all of the shortest paths the nth best 
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path is determined. Thus we have a problem similar to the one in 
Pollack's method. Pollack's method, however, being a shortest path 
problem generates paths with no loops. Such is not the case with this 
method. Paths with loops may well emerge as nth best paths. How much 
of a problem this is depends on the particular results desired. 

The limitation to small networks is escaped by Bellman and Kalaba's 
[1] method. Here the nth best path is determined from all nodes j of 
the network to a given node k. This can be considered an advantage or 
disadvantage depending on what paths are wanted. This method uses the 
functional equation technique of dynamic programming. Restrictions are 
imposed in the method to insure loopless paths. 

Floyd's algorithm provides a basis for the development of the 
following matrix method to determine the nth best path. The method of 
searching the matrix remains the same but now additional calculations are 
performed. Upon completion of this method the first, second, ' ' nth 
best paths are given from all nodes j, to all nodes k. The only restric- 
tions placed on the size of the network, or how large n can be, is the 
amount of computer storage available. The description of the method will 
be given below with the flow diagram given in appendix IV and the full 
computer program in appendix V. 

For the method to determine all alternate best paths the matrix M 
was unchanged, but MR was increased to a three-dimensional matrix. To 
accommodate the nth best path both matrices must be three-dimensional. 

M and MR will be dimensioned ND x ND x NK. NK is equal to the pre- 
determined value of n. Now, m.. will contain the distance of the pth 

J Kp 

best path from j to k and mr.. will contain the first node of the pth 

J 

best path from j to k. 
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To determine the nth best path from j to k, the followinq operation 
is performed. 

"jkn '"'"['"jkn- ""'"n <™j1p * ”ikq>] 

P = 1. ' ' NK 

q = 1 . • • • , MK 



Essentially this operation forms all combinations of paths from j to k 
throuqh i. Since not all of the NK p's or q's may be non-infinity, there 
will be a maximum of (NK) of these paths. The path throuqh i with the 
nth best distance is compared with the existing path, The minimum 

ic * 

of these two paths is The m^i^^ replaced by m^j^^ is not simply 

discarded but becomes the m^j^ best distance. (It can be observed 
that when n, p and q are all one, the above operation reduces to the 
same operation originally described in the Cascade Algorithm and 
Algorithm 97. ) 

To illustrate the procedure consider the network in figure 5 and 
its associated initial distance matrix given below. 
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INF 
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INF 


INF 


INF 


INF 
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INF 


INF 
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0 



The first non-infinity column element encountered is = ^121. 

Searching row 2, the first non-infinity element is m^. = ni22-| • Follow- 
ing is the first set of comparisons. 

1.1 ms — m^ 21 ^231 ~ ^ ^ ~ ^ ^ ~ ^ 

m-|2i ms 

1.2 ms = mi2i + 1TI221 = 9 < m-|22 “ 

™132 5 
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Fiaure 5 



Network for Nth Best Path Example 
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Continuing across row 2, 



2.1 ms 



m-|2i ^251 ~ ^ ^ ~ ^ ^ ^151 ~ INF 



m^51 :- 10. 



Following are the steps for column 3. 



3.1 ms = m-|2i + m^^i = 4 + 4 = 8 < m^^-j = 9 

'"142 “mi ° ^ 

"141 ® 

3.2 ms = m-|22 + ni^^i = 9 + 4 = 13>m^42 = 9 

m-j ^2 • ^ 

3.3 ms = m^22 '^341 = 13 < m-j^^ “ 

mi43 := 13 

4.1 ms = m23i + m^^i = 6 + 4 = 10 < m24i = INF 



m 
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:= 10 



5.1 ms = mg 2 i + =9 + 4=13 = mg^-j 

01541 

At this point the matrix would be as given below. 

M = 



0 






3 ' 
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Upon completion of the algorithm, M* would appear as below. 



M’' 
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INF 

INF 
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17 



As before, the columns of the matrices are divided by double lines. 
Between the double lines are the three elements of the third dimension, 
the first, second and third best distances from j to k. 

Proof of the nth best path algorithm relies on the proof of 
Algorithm 97. For if Algorithm 97 is valid, it must be true that all 
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possible combinations of paths are enumerated and only the shortest 
retained. If Algorithm 97 fails to consider even one path from j to k, 
then no claim can be made of its validity. For there can be no guarantee 
that this one neglected path is not the shortest. The proof of Algorithm 
97 has been sufficiently established by Warshall [19], Murchland [15] and 
Hu [11]. Thus, all possible combinations of paths from j to k are con- 
sidered and only the shortest kept. For the nth best path algorithm, 
the remaining paths are not discarded. All paths are essentially placed 
in order and stored. 

The procedure employed in constructing MR to enable the path to be 
enumerated is the same as before. First node replacement occurs immedi- 
ately after the distance replacement. Considering the preceding example, 
replacements in MR would occur as follows. 



1.2 


mri32 


:- mr^2i 


= 2 


2.1 


"’^ISl 


:= mr^2i 


= 2 


3.1 


mri42 


:= mr^4^ 


= 4 




mri4i 


:= mr^3^ 


= 3 


3,3 


mri43 


:= mr^32 


= 2 



At this point the first row of MR would appear as the following. 

||l I I 112 I I 113 I 21 113 14 I 2 II 21 I I 

Following is MR as it exists upon completion of the algorithm. 
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Extraction of the path from MR is somewhat different than in the 
previous examples. The first node of the nth best path from j to k will 
not necessarily be found in the nth, third dimensional element. Con- 
sider the nth best path u = (j, ' ", p, ’ ’» ’ *»!<)• The first node 
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of the path u would be and found in the nth element. Succeeding 

first nodes may be found in the nth element until say the pth node is 



reached. Now the first node of the path from p to k may be in the n-lst 

element, indicating that this is now the n-lst best path from p to k. 

Continuing, the path from q to k may be the first best path. Thus, the 

distance matrices (including original) must be used in conjunction with 

the routing matrices as the path is traced from j to k. Upon reaching 

the first node of u, the distance of the arc from j to must 

★ 

be subtracted from the total distance of u. The elements of m ^ . are 

mrjkn.k 

now searched for this lesser distance. The third-dimensional element 
will indicate what best path we shall continue on. 

•k 

Using matrices M, M , and MR let us determine the second best path 
from node 1 to node 5. From we obtain the first node as 3. Sub- 

tracting the original m-i^i from the total distance of the path m-|g 2 = 16, 
we obtain m^g^ = 12. Searching m^g^j we find i = 1, meaning from now on 
we are on the first best path so no more subtracting is necessary. Con- 
tinuing, nir^gi = 4 and lastly ^^^51 = 5. Thus, the second best path from 
1 to 5 is u = (1, 3, 4, 5) and has a distance of 16 units. 



10. The Traveling Salesman Problem 

Algorithm 97 determines the shortest path from j to k. The first 

extension discussed allowed us to expose all possible minimum paths. In 

both cases m.. was initialized to zero. If, instead, m.. was set to 
J J JO 

infinity, we could have extracted the minimum circuits. Extending this, 

if m.. was set to infinity in the nth best path algorithm, we would have 
J J 

obtained the nth best circuit from j to j, for all j. If the nth best 
circuit contains all the nodes of the network and the only node appearing 
more than once is j, which appears exactly twice, first and last, that 
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circuit is defined as a tour and is a contender for the optimal solution 
to the traveling salesman problem. Thus, the traveling salesman problem 
modeled- as a nth best path problem is next to be investigated. 

The nth best path formulation in the previous section is not a 
minimum path formulation, as is Pollack's. Thus, paths with loops can 
be expected. This could be remedied by the insertion into the computer 
program of a subroutine called, say, MOLOPS. Each time a new path was 
formed by adding two paths, NOLDPS would construct the path and discard 
it if it obtained a loop. 

Thus we are assured of loopless paths. Recall that alternate nth 
best paths were discarded. Only the first nth best path was retained. 

There is no way of knowing if that discarded alternate nth best path was 
optimal. A way of fixing this would be to compare alternate paths as 
they arise and retain the one with the most nodes. But this is not 
really correct. For that alternate nth best path thrown away may have 
combined with some other path and formed an optimal circuit. Thus, all 
alternate nth best paths must be retained. Now, all alternate nth best 
combinations of paths must be considered. This could be accomplished by 
adding a forth-dimension to the matrices M and MR. Each would be dimen- 
sioned ND X ND X NK X NA and m., would be the pth alternate nth best 

jknp 

path from j to k. Upon completion of the algorithm the n best circuits 
from j to j would be searched and the first tour encountered would be 
an optimal solution. 

These modifications would seem to overcome the difficulties of the 
nth best formulation. The optimal solution would be an exact solution to 
the traveling salesman problem. It is anticipated, however, that to handle 
large networks in this way a computer would have to satisfy the following 
conditions , 
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1. Handle four dimensions 

2 . Have a storage capacity larger than even the present 
day advanced computers 

3. Be faster than the present day computers 
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APPENDIX I 



Flow Diayrdin for the Shortest Path Alqorithm 
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APPENDIX II 



Flow DiaoraiP for the All Alternate Path Algorithm 
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AoPENniX III 



rnRTRAN IV COWPIITER PROGRAM FOR THF ALL ALTERNATF 
PATH ALGORITHM 



C INt- = INFI-\ITY 
C Or = NUMRER OF' HOOFS 

C NA-*^AXIMUM NUMBER OF EXPECTED FIRST MOOES 
C HGO=FIRST NGOF OF PATH TO BE PRINTED OUT 
C NENO=LAST NOOh OF PATH TO BF PRINTED OUT 
C MAlT=1 if DESIRE ALL ALTERNATE PATHS FROM NODE NGO TO 
C NCDE NFNOfO IF NOT 

C NVAT=1 IF DESIRE ALL ALTERNATE ROUTING MATRICES TO RF 
C PRINTED 0UT,0 IF NOT 

C M( I , J)=MATR IX OF DISTANCES FROM I TO J . AS READ IN, IS 
C DISTANCE OF SINGLE ARC FROM I TO J,OP INFINITY IE NO 

C sue-* Arc EXISTS. AS PRINTED OU F , I S S^-OPTEST OISTAOrr 

C OF F'ATH FROM [ yo J 
C MP( I , J,K) =HOUTI NG MATRIX 

C N1 ,N2=PARAMETFR S USED TO FACILATE PRINT OUT 
COMMON I NF , NO , NA , NGO, NEND, M , MR 
DIMENSION M(30,50) ,MR(50,50,10) 

NAMELIST/INPUT/M 
C READ AND PRINT PARAMETERS 

READ 33, ItMF,Nn,NA,NGO,NEND,NALT,NM4T,Nl,N2 
PRINT 38 , INF , ND , N A , NGO, NEND , NAL T , NMAT , M 1 , N2 
ALL ELEMENTS OF ( I , J ) ARE SET TO INFINITY EXCEPT 

DIAGONAL ELFMENTR WHICH APE SET TO ZERO. MR(I,J,K) IS 
INI TI ALIZEO 
CO 12 I=1,ND 
DO 11 J=l,NO 
J,I ,1 ) = I 
DO 10 K=2,NA 
1C MR( J, I ,K)=INF 

11 M( I , J)=INF 

12 M( I , I )=0 

C READ IN NON-IMFINITY ELEMENTS OF M(I,J) 

READ(5, INPUT) 

C PRINT OUT INITIAL DISTANCE MATRIX 
PRINT 33 

PRINT 39, ( I ,1 = 1, NO) 

DO 13 1=1, ND 

PRINT 40,1 , (M( I , J) ,J=1 ,ND) , I 

13 CONTINUE 

C CONVERT INITIAL MATRIX TO SHORTEST DISTANCE MATRIX AND 
C TRANSFORM ROUTING MATRIX 
DO 20 1=1, NO 
DO 20 J=1,N0 

IF(M(J,I ).FQ.INF) GO TO 20 
IF( I .EQ. J) GO TO 20 
DO 20 K=1,ND 

IF(M( I ,K).EQ.INF) GO TO 20 
IF( I .EO.K) GO TO 20 
MS=M(J,I )+M(I,k) 

IF(MS-M( J,K) ) 14,16,20 

14 M(J,K)=MS 

DO 15 L=1,NA 

15 MR(J,K,L)=MR( J,I ,L) 

GO TO 20 

16 DO 19 L=1,NA 

IF(.MR( J, I ,L) .EO. INF) GO TO 20 
00 17 N=1,NA 

IF(MR( J,K,N) .EO. INF) GO TO 18 
IF(MP( J, I,L)-MR( J,K,N) ) 17,19,17 

17 CONTINUE 
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on 



PRINT 37 
GO TO 32 

18 MR( J ,K,N) =MP ( J, I ,U 

19 CONTINUt 

20 CONTINUE 

C IF NMAT=1 POINT OUT MATRICES 
IF(NN*AT.EO.O» GO TO 31 
C DETERMINE MAXIMUM NUMBER OF FIRST NODES 
IA=1 

DO 22 1=1, NO 
DO 22 J=1,ND 
KA=0 

DO 21 K=1,NA 

IF(MR( I,J,K».LT.INF) KA = KA+1 

21 CONTINUE 
IF(KA.GT.IA) IA=KA 

22 CONTINUE 

C FOR ELEMENTS OF m n , j ) = i nF I N I T Y MAKE CORRESPONDING 
C ELEMENTS OF MR ( I , J , 1 ) = I NF I N ITY 
DO 23 1=1, ND 
DO 23 J=1,ND 

IF( M( I , J) .LT. INF > GO TO 2 3 
MK( I ,J,1)=INF 

23 CONTINUE 

C PRINT OUT SHORTEST DISTANCE MATRIX 
PRINT 3 A 

PRINT 41, ( I,I = 1,NU 
DO 24 I=1,ND 

PRINT 42,1, (M( I,J) ,J=1,N1) , I 

24 CONTINUE 
IF(N2.E0.0) GO TO 26 
PRINT 43, ( I , I=N2,ND) 

DO 25 1=1, ND 

PRINT 42, I , (M( I ,J ) , J=N2,ND) , I 

25 CONTINUE 

C PRINT OUT ROUTING MATRIX 

26 PRINT 35 
CO 30 1=1, lA 
PRINT 41, (L,L=1,N1 ) 

DO 27 J=1,ND 

PRINT 42,J, (MR(J,K,I) ,K=1,N1) , J 

27 CONTINUE 
IF(N2.E0.0) GO TO 29 
PRINT 43, (L,L=N2, ND) 

DO 28 J=1,ND 

PRINT 42,J, (MR(J,K, I) ,K=N2,ND) ,J 

28 CONTINUE 

29 IF(IA.EQ.I) GO TO 30 
PRINT 36 

30 CONTINUE 

IF NALT=1 PRINT OUT ALL ALTERNATE PATHS FROM NODE NGO TO 
NODE NEND 

31 IF(NALT.EO.O) GO TO 32 
CALL ALTERN 

32 CONTINUE 

33 FORMATdHl,' INITIAL MATRIX',//) 

34 FORMATdHl ,» SHORTEST DISTANCE MATRIX',//) 

35 FORMATdHl ,' ROUTING MATRIX',//) 

36 FORMATdHl ,' ALTERNATE ROUTING MATRIX',//) 

37 FORMATdHl,' NUMBER OF FIRST NODES EXCEEDS STORAGE') 

38 F0RMAT(9I8) 

39 F0RMAT(6X,50I2,//) 

40 FORMAT! 13, 3X, 5012, 16) 

41 F0RMAT(6X,25I4,//) 

42 F0PMAT(I3,3X,25I4, 15) 

43 FORMATdHl, 5X, 2514,//) 

END 
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SUBROUTINE ALTERN 

COMMON INF,ND,NA,NGO,NEND,M,MR 

dimension M(50,50) ,MR(50,50,10) 

MIN=M(NG0,NEND| 

PRINT 17,NG0,NEN0,MIN 
PRINT 18 
DO 2 1=1, NO 
M(2, n=o 
DO 1 J=1,NA 

IF(MR( I ,NEND, J).GE. INF) GO TO 2 

1 M(2,I)=M(2,I)+1 

2 CONTINUE 
N=0 

J=1 

K=NGO 

DO 3 1=1, NO 
M( 1, I)=INF 

3 M(3, I )=INF 
M(l, J)=K 
J=J<-1 

4 IF(K-NEND) 5,10,5 

5 IF(M(2,K).LE.l) GO TO 7 
NN=M(2,K)-1 

DO 6 1=1, NN 
N=N+1 

6 M(3,N)=K 
L = K 

7 MAI=M(2,K) 

IF(MAI.EO.l) GO TO 9 
MAI=1 

DO 8 1=1, ND 

IF(M(3,I).E0.K) MAI=MAI+1 

8 CONTINUE 

9 NEXT=MR(K,NEND,MAI ) 

M( 1, J)=NEXT 
K-NEXT 

J = J+1 
GO TO 4 

10 II=J-1 

PRINT 19,(M(1,I),I=1, II) 

IF(N.LE.O) GO TO 16 
DO 11 1=1, NO 

IF(M(1, J-1) .EO.L) GO TO 12 
J=J-1 

11 M(1,J)=INF 

12 CONTINUE 
M(3,N)=INF 
N=N-1 

MAI=M(2,L) 

IF(MAI.EO.l) GO TO 14 
MAI = 1 

DO 13 1=1, NO 

IF(M(3, D.EQ.L) MAI=MAI+1 

13 CONTINUE 

14 NEXT=MR(L,NEND,MAI ) 

Mil, J)=NEXT 

J=J+1 

K=NEXT 

IF(N-O) 4,4,15 

15 L=M(3,N) 

GO TO 4 

16 CONTINUE 

17 FORMATdHl, ‘MINIMUM DISTANCE FROM NODE*, 13, • TO NODE*, 

1 13,' IS', 13,* UNITS') 

18 FORMAT!////,' MINIMUM PATHS') 

19 FORMAT! /, 3013) 

RETURN 

END 
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APPENDIX IV 



Flow Diagram for the Nth Best Path Algorithm 
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APPENDIX V 



FORTRAN IV CO'^PUTER PROGRAM FOR THE NTH BEST 
PATH ALGORITHM 



INF=INF IMITY 
NO=NUMBEP OF NODES 

nk=number of k best paths 

NGO=FIRST node OF PATH TO BE PRINTED GUT 
NEND=LAST node of PATH TO BE PRINTED OUT 
NKTH=1 IF DESIRE ALL K BEST PATHS FROM NODE NGO TO NODE 
NEND,0 IF NOT 

NMAT=1 IF DESIRE ALL K BEST ROOTING MATRICES TO BE 
PRINTED 0UT,0 IF NOT 

M(I,JtK)=MATRIX OF DISTANCES FROM I TO J. AS RFAD IN, IS 
DISTANCE OF SINGLE ARC FROM I TO J,OR INFINITY IF NO 
SUCH ARC FXI,^,rS. AS PRINTED OUT, IS KTH BEST DISTANCE OF 
PATH FROM I TO J 
MR ( I , J, K )=ROUT ING MATRIX 

N1 ,N2=PARAMETEr S USED TO FACILATE PRINT OUT 

DIMENSION M(5C',B0,15» ,MR(5C,5G,15) ,MI( 50,50) 

COMMON INF,NP,NK,NGO,NENn,M,MP ,MI 
NAMELIST/INPDT/M 
READ AND PRINT PARAMETERS 

READ 3C , TNF,ND,NK,NGO,NEND,NKTH,NMAT,Nl,N2 
PRINT 30 , INF,ND,NK,NG0,NFND,NKTH,NMAT, N1 ,N2 
ALL ELEMENTS OF M(I,J,K) ARE SET TO INFINITY EXCFPT 
DIAGONAL, elements FOR K=l, WHICH ARE SET TO ZERO. 
MRU,J,K) IS INITIALIZED 
00 11 1=1, NO 
DO 10 J=1,ND 
MR(J,I,1)=I 
M( I, J,1 »=INF 
DO 10 K=2,NK 
M( I , J,K)=INF 

10 MR(J,I,K)=INF 

11 M( I , I ,1 )=0 

C READ IN NON-INFINITY ELEMENTS OF M(I,j,k) 

REA0I5, INPUT) 

C STORE M(I,J,1) IN MI(I,J) FDR USE IN SUBROUTINE KREST 
DO 12 1=1, NO 
DO 12 J=1,ND 

12 MI(I,J)=M(I,J,1) 

C PRINT OUT INITIAL DISTANCE MATRIX 
PRINT 27 

PRINT 31, ( I , 1=1, NO) 

DO 13 1=1, NO 

PRINT 32, I , (M( I , J, 1 ) , J=1 ,N0) , I 

13 CONTINUE 

C FOR ELEMENTS OF M ( I , J )= I NF I N IT Y MAKF CORRESPONDING 
C ELEMENTS OF MR { I , J , 1 )= I NF I N I TY 
DO lA 1=1, NO 
DO 14 J=1,ND 

IF(M( I, J.l) .LT.INF) GO TO 14 
MR(I ,J,l)=INF 

14 CONTINUE 

C CONVERT INITIAL MATRIX TO KTH BEST DISTANCE MATRIX AND 
C TRANSFORM ROUTING MATRIX 
DO 20 1=1, NO 
CO 2C J=1,ND 

IF(M(J, 1,1) .EQ.INF) GO TO 20 
IF( I .EO. J) GO TO 20 
DO 20 K=1,ND 

IF(M(I,K,1).E0.INF) GO TO 20 
IF(I .EO.K) GO TO 20 
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DO 19 LA=1,NK 
DO 19 LB=1,NK 
MS=M( J, I ,LA)+M( I,K,L8) 

DO 15 LC=1,NK 

IF(MS-M( J,K,LC) ) 16,19,15 

15 CONTINUE 
GO TO 19 

16 NA=NK-LC 
IF(NA.EQ.O) GC TO 18 
DO 17 IA=1,NA 
N8=NK-IA+1 

M( J,K,N8) = M( J,K,N8-1 ) 

17 MR( J,K,NB)=MR(J,K,NB-1) 

18 M(J,K,LC)-MS 

MR( J,K,LC)=MR( J, I ,LA) 

19 CONTINUE 

20 CONTINUE 

C IF NMAT=1 PRINT OUT MATRICES 
IF(NMAT.EO.O) GO TO 25 
C PRINT OUT K BEST DISTANCE MATRICES 
DO 22 J=1,NK 
PRINT 28, J 
PRINT 33,(1, 1=1, Nl) 

DO 21 1=1, NO 

PRINT 3A,I,(M(I,K,J),K=1,N1),I 

21 CONTINUE 
IF(N2.E0.0) GO TO 22 
PRINT 35,(1 , I=N2, NO) 

DO 22 1=1, ND 

PRINT 34, I , ( M( I,K, J ) ,K=N2,N0) , I 

22 CONTINUE 

C PRINT OUT K BEST ROUTING MATRICES 
DO 24 J=1,NK 
PRINT 29, J 
PRINT 33, ( I,I=1,N1 ) 

DO 23 1=1, NO 

PRINT 34,I,(MR(I,K,J),K=1,N1),I 

23 CONTINUE 
IF(N2.EQ,0) GO TO 24 
PRINT 35, ( I , I=N2, NO) 

DO 24 1=1, ND 

PRINT 34,I,(MR(I,K,J),K=N2,N0),I 

24 CONTINUE 

25 IF(NKTH.EQ.O) GO TO 26 

C IF NKTH=1 PRINT OUT ALL K BEST PATHS FROM NODE NGO TO 
C NODE NENO 

CALL KBEST 

26 CONTINUE 

27 FORMATdHl,* INITIAL MATRIX',//) 

28 FORMATdHl ,I4,'TH BEST DISTANCE MATRIX',//) 

29 FORMATdHl ,I4,'TH BEST ROUTING MATRIX',//) 

30 F0RMAT(9I8) 

31 F0RMAT(6X,5CI2,//) 

32 F0RMAT(I3,3X,50I2, 16) 

33 FQRMAT(6X,25I4,//) 

34 FORMAT! 13, 3X, 2514, 15) 

35 FORMATdHl, 5X, 2514,// ) 

END 
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SUBROUTINE KBEST 

COMMON INF , ND,NK , NGO t N END , M , MR , Ml 

DIMENSION M(f)0,50,15) ,MR(50,50,15) ,MI( 50,50),MK(3C) 

PRINT 7 
DO 6 I=l,NK 
ITH=I 

MOIS=M{ NGO.NEND, I ) 

MOIST=MOIS 
DO 1 L=l,30 

1 MK(L)=INF 
KA=NGO 

N = 1 

MK(N)=KA 

2 KB=MR(K \,NEND, ITH) 

N=N+1 

MK(N)=KB 

I F ( KB. EQ. NEND) GO TO 5 
MOIS=MniS-MI (KAtKB) 

DO 3 J=1,NK 

IF(M(KB,NFNO, J) .EO.MDIS) GO TO 4 

3 CONTINUF 

4 ITH=J 
KA = KB 
GO TO 2 

5 PRINT 8, I ,NGO,NEND,MOIST 
PRINT 9, ( mk(L) ,L=1,N) 

6 CONTINUE 

7 FORMAT! IHl ) 

8 FORMAT! ///, 14, *TH 8FST OISTANCF FROM NODE', 13,' TO NODE', 

1 13, ' IS* , 15, ' UNITS' ) 

9 FORMAT! //, 3013) 

RETURN 

END 
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